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AN  OBJECTIVE  COLOR  MEASUREMENT  SYSTEM; 

phase  iv  industry  trial 


INTRODUCTION 


BACKGROUND 


To  dat?*  DP SC,  tne  United  States  Army's  procurement  agency  in 
Philadelphia,  PA,  has  evaluated  dyed  or  printed  textile  materials  for 
conformance  to  shade  acceptabi 1 i ty  specifications  by  the  visual  method 
traditionally  used  within  the  textile  industry.  The  method  has  been 
standardized  so  that  the  government  observer  evaluates  the  procurement 
samples  against  a  standard  sample  and  physical  tolerance  limit  samples 
under  specifies  illumination  ana  viewing  conditions.  However,  conflicting 
interpretations  of  what  constitutes  an  acceptable  color  difference 
sometime  occur  because  the  pass/faii  acceptability  judgment  is  ultimately 
the  subjective  opinion  of  the  experienced  observer.  These  conflicts  are 
caused  ir  cart  by  differences  among  observers  in  the  perception  of,  and 
response  to,  color  stimuli. 

Nh ile  color  is  an  important  attribute  for  any  garment,  color  is  an 
especially  important  considerati on  for  those  garments  used  m  military 
appl ications.  In  addition  to  the  desire  to  achieve  a  compatible 
appearance  tor  components  of  Doth  the  cress  and  combat  uniforms  for 
aesthetic  purposes,  the  colors  selected  for  the  b at tl ear ess  garments  serve 
a  dual  purpose  m  helping  to  protect  the  soldier.  Multi-colored, 
disruptive  camouflage  patterns  printed  on  the  faeries  used  in  combat 
uniforms  are  designed  to  blend  with  terrain  elements  and  to  reduce  the 
threat  of  detection.  Large  deviations  from  the  terrain  colors  reduce  the 
effectiveness  of  the  countersurveillance  properties  and  place  the  soldier 
at  greater  risk  of  detection  by  visual  means  during  the  day  and  by  image 
intensif ication  devices,  which  enhance  visual  capabilities,  at  night. 

In  the  late  1970‘s  Natick  initiated  the  design  and  development  of  an 
objective  method  of  evaluating  shade  acceptabi 1 i ty  as  a  means  of  improving 
the  shade  evaluation  process  and  the  quality  of  military  end  items.  The 
method  developed  uses  a  spectrophotometer  as  an  impartial  observer,  and 
provides  quantitative  colorimetric  data  by  interfacing  the  instrument  with 
a  computer.  A  unique  feature  of  the  method  is  an  objective  color 
difference  equation  based  on  acceptabi lity  rather  than  percept ibi 1 ity. 
Observer  test  data  obtained  for  the  coefficients  in  the  acceptabi 1 ity 
equation  are  based  on  approximately  2400  experimental  color  decisions  made 
by  many  observers.  Therefore,  both  the  contractor  and  the  government  can 
accept  the  pass/fail  decisions  made  by  a  neutral  observer,  the  color 
measurement  system. 

The  system  was  designed  as  a  network  of  instruments.1  The  network 
currently  consists  of  two  host  systems,  located  at  the  government's 


quality  assurance  anq  research  laboratory es,  and  satellite  units  located 
at  several  industry  sites.  Upon  implementation,,  production  samples 
normally  submitted  to  DPSC  f  qr  visual  evaluation  will  be  measured  at 
r.he  contractor's  Taciliti.es  and  the  acceptability  data  transmitted  via  . 
telecommunications  to  DPSC  -for  analysis,  thus  reducing  the  turn-around' 
time  -for  the  evaluation  process. 

The  early  stages  o-f  this  program  focused  an  the  design,  development,, 
procurement  and  testing  of  a  prototype  system.  The  objectives  of  Phases 
I  and  II  were  to  design  the-  system,  and  to  develop  an  objective  method 
far  establishing  shade  tolerances  with  the  use  of  a  color  difference 
i4A)  equation  based,  on  acceptability,2*^^4**  In  Phase  III,  the  system 
of  five. units  was  assembled  and  the  performances  of  the  instrumentation 
tested,  as  individual  units  and  as  a  system.**-^**  Another  achievement 
in  Phase  HI.  was  the  derivation  of  numerical  acceptabi  1 1  ty  tolerances 
for  three  standard  snad.es.  These  tolerances  were  used,  in  a  snort 
operational  trial  which  found  the  level:  of  agreement  in  visual/ 
instrumental  and  instrumental /instrumental  acceptability  decisions  to  be 
very  good.* 

PHASE  IV:  INDUSTRY  TRIAL 

The  purpose  of  the  final,  phase  of  this  project  was  to  determine 
whether  the  degree  of  correlation  between  visual  -and  instrumental,  ana 
the  inter instrumental  accepted! 1 i ty  judgments .achieved  in  the.  laboratory 
could  be  reproduced  in  a  production  environment  over  an  extended  period 
of  time,  and  to  fine  tune  any  problem  areas  prior  to  full  implementation 
into  the  government's  quality  assurance  program..  The  implementation  is 
:n  progress  arc  is  expected  to  be  completed  in  1990,. 

procedure 

Three  finishers  under  contract  to  print  woodland  camouflage 
patterned  fabrics  accepted  the  opportunity  to  participate  in  the  study, 

A.  satellite  unit  was.  installed  at  each  facility.  The.  Government  Quality 
Assurance  Representatives  (CAR's),  who  were  to. conduct  the  testing  at 
eac.n  site,  had  no  previous  experience  with  color  measuring 
intrument.ation.  Therefore,  they  received  instruct  ion  in  system 
operation,  measurement  and.  basic  maintenance  procedures,.  The  results  of 
the  study,  were  used  only,  for  research  purposes;  procurement  contracts 
were  not  affected-  by  the  instrumental  pass/f ml:  decisions. 

The  test  was.  conducted  in  a  round-robin  format  as  shown  in  Figure  1, 

Two  woodland  camouflage,  patterned  fabrics  -were*  .studied.  Site- A  tested 
samples  of  water  repel  1  ant  (Quarpel)  treated  50/50'.  nylon/cotton  (nyco) 
twill,  fabric  used  in  the  Chemical  Protective  B.attl.edress  Overgarment,. 
Samples  of  100  percent  cotton,  poplin  ripstop  fabric  used  in  the  Hot 
Weather  Battledress  Uniform  (HWBDU)  were ’ measured,  at  sites  B  and  C.  The 
QAR's  were,  instructed  to  pull  the-  test  samples  from  the.  samples  normally 
sent  to  DPSC  for  verification  testing.  According  to  standard  sampling 
procedures,  these  samples  are  randomly  chosen  from  within  the  production 
lot. 


PHASE  IV:  INDUSTRY  TRIAL 


Figure  1 

Round-Robin  Format  for  Phase  IV:  Industry  Preoperational  Trial 


The  samples  varied  somewhat  in  size  depending  on  the  industry  site 
of  origin.  For  example,  samples  from  one  site  were  approximately  20 
inches  x  20  inches  while  samples  from  another  were  12  inches  x  20 
inches.  The  QAR’s  selected  and  marked  two  measurement  areas  on  the 
reverse  side  of  every  sample  for  each  of  the  three  shades  studied: 

Light  Green  354,  Dark  Green  355  and  Brown  356.  All  measurements  were 
made  polychromatical ly ,  using  a  simulated  D«o  illumination  source, 
inclusion  of  the  specular  component  and  large  area  of  view  mode  (25  mm 
area  viewed).  The  test  participants  were  instructed  to  recalibrate  the 
instrument  if  the  measurement  session  exceeded  two  hours.  A  two-hour 
calibration  cycle  was  used,  rather  than  the  four-hour  cycle  recommended 
by  the  instrument  manufacturer  as  a  control  measure. 

Each  test  site  was  supplied  a  piece  of  the  standard  roll  with  the 
measurement  areas  marked  on  the  reverse  side  of  the  fabric.  The  standard 
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and  production  samples  were  sacked  at  tne  port  with  a  numoer  of  layers  of 
the  same  faoric  anc  color  until  infinite  thickness  was  obtained.  Four 
layers  were  used  to  pack  each  snade  pf  tne  cotton  poplin  ripstop  fabric* 
Two  layers  were  used  to  pack  each  shade  of  the  Quarpel -treated  nycc  twill 
faoric.  To  minimize  the  influence  of  surface  texture  on  the  instrumental 
readings,  the  Diagonal  weave  lines  cf  the  nyco  twill  samples  ana  the 
reinforcement  ribs  in  the  filling  direction  cf  tne  ripstop  samples  were 
oriented  to  the  horizontal  plane  when  presented  to  the  sample  port.  The 
standard  sample  was  measured  each  time  a  new  lot  was  tested.  Two 
measurements  were  taken  in  different  areas  for  each  shade  and  the  values 
averaged.  The  colorimetric  data  were  calculated  for  0*9  and  the  Clfe 
1964  10  degree  standard  ofi server..1* 

After  the  samples,  were,  measured'  at  the  printing  facility,,  they  were 
sent  to  DPSC  for  visual  evaluation'  of  the  shade  and  instrumental 
measurement.  Natick  performed  tjhe  last  round  of  instrumental 
measurements.  The  data  from  all  the.  sites  were  transmitted  via 
telecommunications  to  Natick  for  compilation  and  analyses. 

The  pass/fail  acceptability  data,  were  calculated  using,  the  A-A  color 
difference  equation  developed  in  Phase  II  by.  Nati,c:k  in  conjunction  with 
Allen  and  Yuhas  of  Lehigh  University..  Using  the.  Ailen/Yuhas  method, 
acceptafci  1  ity  is.  defined  by.  an  el  1  lpspid.  in  CIELAB  space,  with' tne 
standard  plotted  at  the  center,  ^  The-  three  axes  of  tne  ellipsoid  are 
defined  by  constants  which  correspond  to  tne-  three  directions  in  color 
space;  nue,  chroma  and-  lightness.  The  length  of  ea.cn  axis  corresponds  to 
the  limit  of  acceptability  in  that  direction.  A  fourth  constant  cefires 
the,  orientation  of  the  ellipsoid  in  tne.  chromatid ty  cl ane. 

AA  represents  an  ellipsoid  with  its  maximum' limit  set  equal  to  1.0. 
Therefore,  a  sample,  with  a  value.  of-AA  less,  than  or  equal  to  1.0  would  ce 
acceptable.  However,  it  is  possible,  to  scale  AA  now  ard  or  downward  from' 
1,0  and  still  maintain- the  relative  sizes,  of  the  chroma,  hue  and  lightness 
axes,  if  the  situation  warrants  such  a  correction. 

The,  acceptability  equation  which  defines- the  ellipsoid  is  as  follows: 

A-A  ~  [gu  (Aa*'>.2-+.  2gx?..  a*>b*  +  gs^TAb*) **  +*  gw<AL*)  =] . 1/a8, 

The  coefficients  guf  2gia,  g2a  and.  are-  givenrby  the- 
following  equations:, 

8.,®vtan“x 

Qix  -  (cos28/ca)-  +  (sin^Q/h*) 

2gl2  .  =  .  2sin0cos0f (1/c2)  -  ( 
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9 t2s  “  '.sina0/caJ  +  (cosat*/ha) 
g33  =  1 /v2 


Where:  a0*,  Q0*  -  CIElAB  a*  and  b*  of  the  standard  and  the  values  for 
c,  h  and  v  are  chroma,  hue  ana  lightness  tolerances  obtained  from  the 
observer  panel  data. 

This  equation,  as  well  as,  the  numerical  chroma,  hue,  lightness  and 
maximum  A  A  tolerances  for  each  of  the  three  shades  studied  were  programmed 
into  the  computers.  The  acceptadi 1 i ty  criteria  for  this  trial  study  are 
listed  m  Table  1.  They  are  tne  same  numerical  chroma,  hue  and  lightness 
tolerances  developed  for  the  nyco  twill  fadric  in  Phase  III.  These 
tolerances  were  used  for  both  faorics  studied. 

However,  the  overalldA  tolerances,  which  represent  the  maximum 
allowable  difference  in  color  to  the  standard  sample,  were  adjusted  to 
reflect  the  broad  visual  tolerance  range  which  exists  for  tne  Quarpei- 
treated  nyco  twill  and  the  cotton  poplin  ripstop  fabrics.  The  maximum  4A 
values  used  as  the  pass/fail  criteria  are  listed  in  Table  2.  Figure  2 
shews  the  acceptability  ellipses  for  the  colors  on  the  cotton  poplin 
ripstop  faerie  plotted  in  CIELAB  color  space. 

^able  Numerical  Tolerances  for  Three  Colors  of  the  koocland  Pattern 


Li  ant  Green  354 

Brown  356 

Chroma: 

1 . 32 

1,30 

1.23 

Hue: 

1.16 

1.11 

0.74 

Lightness: 

n  ns 
.  V.Q 

2,  20 

1.58 

Table  2.  Max l mum  A  A  Values  for  Three  Colors  of  the  woodland  Pattern 
Printed  on  1007.  Cotton  Poplin  Ripstop  and  Quarpei- 
treated  Nyco  Twill  Fabrics 


ui  qht 

Green  354 

Dark  Green  355 

Brown  356 

Cotton  Poplin  Ripstop: 

1 . 90 

n  r>cr. 

2.  55 

Quarpel -treated  Nyco  Twill: 

2 . 05 

2.06 

2.23 

RESULTS  AND  DISCUSSION 

The  analysis  was  conducted  on  a  total  of  approximately  1250  samples 
including  380  Quarpel -treated  nyco  twill  and  870  cotton  poplin  ripstop 
samples.  Another  200  cotton  poplin  ripstop  samples  were  required  to  be 
kept  on  file  at  DPSC  and  were  excluded  from  tne  sample  population. 
Preliminary  analyses  indicated  some  erratic  data  which  clearly  resulted 
from  a  measurement  error,  such  as  measuring  the  wrong  color.  The 
exclusion  of  this  data  from  the  sample  files  for  the  site  wnere  tne 
measurement  errors  occurred  accounts  for  the  slightly  uneven  distribution 
of  the  total  number  of  tests  conducted  at  each  site,  as  listed  in  ^ables  3 
and  4. 


b 


b* 


STANDARD  AND  LIMIT  SAMPLES  FOR 
THREE  SHADES  PLOTTED  WITH 
INSTRUMENTAL  ACCEPTABILITY  ELLIPSES 


* 


Stanearc  and  Limit 


Samples  for  Tnree  Spaces  Plottec  witn  Instrumental 
Acceptability  Ellipses 
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All  t“5  samp  1  es  included  in  this  test  were  judged  as  :,d asses"  when 
visually  evaluated  ter  acceptaoi I i tv  at  DFSC.  when  all  tre  testing  had 
beer-  completed  arc  tne  data  compiled  at  Nat:  :x ,  it  was  analyzed  to 
determine  the  level  cp  agreement  between  the  visual  and  instrumental 
judgments  and  then  oetweer.  'tne  interinstrumental  pass/tail  judgments.  The 
mterinstrumental  agreement  was  determined  by  comparing  the  pass/fail 
judgments  for  each  of  the  satellite  sites  with  those  of  Natick  and  DPSC, 
~he  results  tor  both  the  visual /instrumental-  and  inter instrumental 
analyses  are  found  in  Taoles  3  and  4. 


COMPARISON  OF  VISUAL  AND  INSTRUMENTAL  ACCEPTABILITY  DECISIONS 

The  level  at  agreement  between  the  visual  and  instrumental  judgments 
was  high.  The  same  pass/fail  judgment  was  made  by  both  the  visual  and 
instrumental  evaluations  for  at  least  93.2  percent  of  the  samples  at  each 
test  site,  with  the  exception  of  the  Light  Green  354  samples  tested  at 
site  C.  There  the  level  of  agreement  was  80.5  percent. 


Table  3.  Agreement  of  Visual /Instrumental  Pa ss/Faii  Judgments  (*/.) 
Woodland  Pattern  Camouflage  Colors 


_t ,  Green  354 

Dk.  Green  355 

Brown  356 

Natick 

95.  7 

97.9 

93.2 

n=12l0 

n=1224 

n- 1221 

DPS  2 

?6. 9 

97.  6 

96. 6 

n=U82 

n=U9l 

n-1213 

A 

9£.  3 

96.  1 

95.5 

r,=383 

n=3  83 

n = 379 

b 

99,8 

93.7 

100 

n~65  6 

n=638 

n=632 

c 

80.5 

94.5 

94.3 

n=226 

n=22i 

n=234 

n=  Total  number  of  tests 


Examination  of  the  numerical  acceptability  data  for  this  group  of 
samples  revealed  that  a  significant  number  (45)  had  acceptability  factors 
slightly  higher  than  the  maximum  numerical  tolerance.  The  data  for  the 
Light  Green  samples  were  then  plotted  against  the  data  for  tne  visual 
limit  samples  and  the  numerical  tolerances  in  CIELAB  color  space.  The 
ellipse  in  Figure  3  shows  that  the  Light  Green  samples  from  site  C  fall 
just  beyond  the  maximum  limit  for  botn  the  visual  and  numerical  tolerance 
limits.  The  procurement  samples  which  fall  inside  the  ellipse  exceeded 
the  maximum  tolerance  for  lightness,  the  third  dimension  of  color  space, 
which  cannot  be  plotted  here. 

While  these  samples  were  visually  judged  to  be  acceptable,  tne 
borderline  of  acceptabi 1 i ty  is  an  area  where  the  visual  observer  is 
expected  to  experience  some  difficulty  in  making  a  judgment.  This 
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O  =  Visual  LimitSamples 

-I-  =  Samples  Submitted; 
by  Contractor  C 

Figure  3 

Riot  o*f  Limit  Samples.,  Numerical  Acceptabil  ity  Ellipse  and  Procurement 
Samples  o*  Light  Green  354.,  1007.  Cotton  Poplin  Ripstop  Submitted  by 
Site  C  in  CIElAB  Color  Space. 
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difficulty  is  increased  wner-  the  visual  observer  must  jucge  a  single  color 
r^ZiTi  within'  a  complex  field  of  -four  colors  present  in  the  camouflage 
material.  The  number  of  samples  wnicn  exceeded  the  maximum  acceptaDi lity 
tolerance  had  a  greater  influence  on  the  level  of  agreement  for  site  C, 
because  the  sample  population  for  that  site  was  much  smaller  than  the 
total  population  of  samples  measured  at  Natick  and  DPSC. 


COMPARISON  Dr  INTER INSTRUMENTAL  ACCEPTABILITY  DECISIONS 

The  interinstrumental  agreement  was  also  quite  good.  Table  4 
illustrates  a  nigh  level  of  agreement  ranging  from  67,6  to  99.7  percent  on 
instrumental  pass/fail  decisions  for  all  test  sites..  The  slightly  lower 
levels  of  agreement  for  samples  tested  at  site  C  may  once  again  be  a 
reflection  of  the  small  sample  population  for  that  site. 

The  interinstrumental  data  were  also  examined  to  determine  what 
difference,  if  any,  existed  in  the  acceptabi 1 l ty  factors  (AA>  calculated 
for  the  sample  data  measured  at  each  site*  The  results  indicate  that  for  a 
majority  of  the  data  there  is  a  close  relationship  among  the  A  A  values 
produced  in  testing  at  the  satellite  sites  and  Natick  and  DPSC. 

Table  4.  Agreement  of  Interinstrumental  Pass/Fail  Judgments  (7.) 


Natick 

DPSC 

Natick/DPSC 

A 

91.4 

97.2 

CO 

o 

t-fl 

n«l 122 

n=1077 

n=1077 

B 

99.6 

99.5 

99.7 

n-1902 

n*1891 

n=!S94 

r 

90.8 

90.5 

37. 6 

n=6  09 

n~592 

n-597 

n=  Total  number  of  tests 


The  graphs  shown  in  Figures  4  to  30  represent  the  patterns  found  in 
the  analysis  and  depict  all  possible  pairwise  combinations  of  A  A  values 
for  each  of  the  test  sites,  on  each  of  the  three  colors  tested.  Each 
graph  presents  the  total  set  of  data  points  with  the  four  possible 
judgments.  The  judgment  was  considered  an  agreement  in  the  two  cases 
where  the  paired  test  sites  either  both  passed  or  both  failed  a  test 
specimen.  The  judgments  considered  disagreements  occurred  in  the  two 
cases  where  one  test  site  passed  the  test  specimen  and  the  other  failed 
it.  Each  of  these  judgments  is  represented  by  a  different  symbol  as 
described  in  the  legends  for  the  graphs.  The  pest  fit  regression  line  for 
the  total  set  of  points  is  displayed  along. with  the  95  percent  confidence 
interval  for  individual  points  around  this  line.  The  band  that  is  formed 
represents  the  area  where  there  is  a  95  percent  confidence  that  additional 
points  would  occur  if  more  samples  were  tested.  It  should  be  noted  that 
the  majority  of  data  points  illustrated  represent  samples  which  were 
judged  as  "passes0  by  Doth  instruments. 
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FIGURE  4 

SITE  AUGHT  GREEN  364 
QUARPEL  TREATED  50150  NYCO  TWLL 
AA  -  SfTE  A  VS.  AA  -  DPSC 
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FIGURES 

SfTE  A  BROWN  366 
QUARPEL  TREATED  5QSONYCO  TWILL 
AA  -  SHE  A  VS.  AA  -  DPSC 
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FK3UHE  5 

SfTE  A  DARK  GRffN  3K 
QUARPEL  TREATH)  5QASO  NYCO  TWU. 
_ AA  -  SfTE  A  VS.  AA  -  DPSC _ 

LEGEND  FOR  SYMBOLS 
FIGURES  4-6 

FIGURES  4-6,  UNEAR  REGRESSION  FIT  AT  95  PERCENT 
CONFIDENCE  LEVEL  COMPARING  AA  NATICK  VS.  AA  DPSC 
FOR  THREE  SHADES  OF  THE  WOODLAND  CAMOUFLAGE 
PATTERN,  QUARPEL  TREATED,  50/50  NYCO  TWILL 


•  =  BOTH  DPSC  AND  SfTE  A  PASS 
a  -  BOTH  DPSC  AND  SHE  A  FAL 
A  =»  DPSC  -  PASS,  SITE  A  -  FM. 
.  =  DPSC  -  FAIL,  SITE  A  -  PASS 


. .  '  1  *  '  »  I  »  TT-W  j  .  f  . 

1  2 

AA  -  NATICK 
RQURE7 

SITE  A  LIGHT  GREEN  364 
QUARREL  TREATED  50/50  NYCO 1WHJL 
AA  -  SITE  A  VS.  AA  -  NATICK 


1  2  3 

AA  -  NATICK 


FIGURE  9 

STTE  A  BROWN  366 

QUARPEL  TREATED  50/50  NYCO  TWILL 
AA  -  SITE  A  VS.  AA  -  NATICK 
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FIGURES 

SITE  A  DARK  GREEN  355 
QUARPEL  TREATED  SQJ50NVGOTW1L 
_ AA  -  SHE  A  VS.  AA  -  NATICK _ 

LEGEND  FOR  SYMBOLS 
FIGURES  7-9 

FIGURES  7-9,  UNEAR  REGRESSION  FTT  AT  95  PERCENT 
CONFIDENCE  LEVEL  COMPARING  £A  NATICK  VS.  AA  STTE  A 
FOR  THREE  SHADES  OF  THE  WOODLAND  CAMOUFLAGE 
PATTERN,  QUARPEL  TREATED,  50/50  NYCO  TWILL 


•  =  BOTH  NATICK  AND  SITE  A  RASS 
a  -  BOTH  NATICK  AND  STTE  A  FAIL 


A  *  NATICK  -  RASS,  SITE  A  -  FAIL 
.  -  NATICK  -  FAIL,  SITE  A  -  RASS 
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FIGURE  10 

SnE  A  LIGHT  GREEN  364 
QUARPEL  TREATED  5050  NYCO  TWILL 
tA  -  NATICK  VS.  AA  -  DPSC 


FIGURE  12 
SITE  A  BROWN  356 
QUARPEL  TREATED  50/50  NYCO  TWILL 
AA  -  NATICK  VS.  AA  -  DPSC 
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ROUREfl 

SITE  A  CARK  GREEN  355 
QUARPEL  TREATS)  OTSO  NYCO  TWIL 
AA  -  NATICK  VS,  AA  -  DPSC 


LEGEND  FOR  SYMBOLS 
FIGURES  10-12 

FIGURES  10-12,  UNEAR  REGRESSION  FIT  AT  95  PERCENT 
CONFIDENCE  LEVEL  COMPARING  AA  NATICK  VS.  AA  DPSC 
FOR  THREE  SHADES  OF  THE  WOODLAND  CAMOUFLAGE 
PATTERN,  QUARPEL  TREATED,  50/50  NYCO  TWILL 


DP9C  AND  NATICK  RA5S 
DPSC  AND  NATICK  FAIL 

-  WVSS,  NATICK  -  FAIL 

-  FAIL,  NATICK  -  PASS 
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FIGURE  14 

SHE  B  DARK  GREEN  355 
100%  COTTON  POPUN  RJPSTOP 
_ AA  -  SHE  B  VS.  AA  -  DPSC 

LEGEND  FOR  SYMBOLS 
FIGURES  13  -  15 

FIGURES  13  -  15,  UNEAR  REGRESSION  FIT  AT  95  PERCENT 
CONRDENCE  LEVEL  COMPARING  AA  SITE  B  VS.  AA  DPSC 
FOR  THREE  SHADES  OF  THE  WOODLAND  CAMOUFLAGE 
PATTERN,  100%  COTTON  POPUN  RIPSTOP 


•  =  BOTH  DPSC  AND  SHE  BRASS 


a  -  BOTH  DPSC  AND  SITE  B  FAIL 
A  =  DPSC  -  RASS,  SITE  B  -  FAIL 
.  =  DPSC  -  FAIL,  SITE  B  -  RASS 


OjO  02  04  06  02  IjO  12  14  1.6  12  20 
AA  -  NATICK 


FIGURE  18 

SITE  B  LIGHT  GREEN  364 
100%  COTTON  POPLIN  RPSTOP 
AA  -  SITE  B  VS.  AA  -  NATICK 
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AA  -  NATICK 


FIGURE  18 
SITE  B  BROWN  356 
100%  COTTON  POPUN  RPSTOP 
AA  -  SITE  B  VS.  AA  -  NATICK 


FIGURE  17 

SITE  B  DARK  GREEN  355 
100%  COTTON  POPUN  RPSTOP 

_ AA  -  SITE  B  VS.  AA  -  NATICK _ 

LEGEND  FOR  SYMBOLS 
FIGURES  16  -  18 

FIGURES  16  -  18,  UNEAR  REGRESSION  FIT  AT  96  PERCENT 
CONFIDENCE  LEVEL  COMPARING  AA  SITE  B  VS.  AA  NATICK 
FOR  THREE  SHADES  OF  THE  WOODLAND  CAMOUFLAGE 
PATTERN,  100%  COTTON  POPUN  RIPSTOP 


•  =  BOTH  NATICK  AND  STTE  B  PASS 


a  -  BOTH  NATICK  AND  STTE  B  FAIL 
A  =  NATICK  -  PASS,  SITE  B  —  FAIL 
.  -  NATICK  -  RAIL,  SITE  B  -  PASS 


HGURE19 

8TI1 *  LIGHT  GREEN  354 
100%  COTTON  POPLIN  RIPSTOP 
AA  -  NATICK  VS.  M  -  DPSC 


RQURE20 

Sm  B  DARK  GREEN  365 
100%  COTTON  POPUN  WPSTOP 

_ M  -  NATICK  VS.  AA  -  DPSC _ 

LEGEND  FOR  SYMBOLS 
FIGURES  19-21 

RGURES 19  -  21,  UNEAR  REGRESSION  FTT  AT  96  PERCENT 
CONFIDENCE  LEVEL  COMPARING  AA  NATICK  VS.  AA  DPSC 
FOR  THREE  SHADES  OF  THE  WOODLAND  CAMOUFLAGE 
PATTERN,  100%  COTTON  POPUN  RIPSTOP 


*  =  BOTH  DPSC  AND  NATICK  PASS 
a  -  BOTH  DPSC  AND  NATICK  FAIL 
A  =  DPSC  -  PASS,  NATICK  -  FAIL 

•  -  DPSC  -  FAIL,  NATICK  -  PASS 
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FIGURE  22 

SfTl  C  LIGHT  GREEN  364 
100%  COTTON  POPUN  RIPSTOP 
AA  -  SHE  C  VS.  AA  -  DPSC 
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AA  -  DPSC 


FIGURE  24 
SITE  C  BROWN  356 
100%  COTTON  POPUN  RIPSTOP 
AA  -  SITE  C  VS.  AA  -  DPSC 
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FIGURE  23 

SITE  C  DARK  GREEN  355 
100%  COTTON  POPUN  RIPSTOP 

_ AA  -  SITE  CVS.  AA  -  DPSC _ 

LEGEND  FOR  SYMBOLS 
FIGURES  22-24 

FIGURES  22  -  24,  UNEAR  REGRESSION  FIT  AT  95  PERCENT 
CONFIDENCE  LEVEL  COMPARING  AA  STTE  C  VS.  AA  DPSC 
FOR  THREE  SHADES  OF  THE  WOODLAND  CAMOUFLAGE 
PATTERN,  100%  COTTON  POPUN  RIPSTOP 


DPSC  AND  SHE  CRASS 
DPSC  AND  SHE  C  FAIL 

-  RASS,  SITE  C  -  FAIL 

-  FAIL,  SHE  C  -  RASS 
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M-  NATICK 


FIGURE 25 

SITE OUGHT  GREEN  354 
KH%  COTTON  POPUN  R1PSTOP 
M  -  STC  C  VS.  AA-  NATICK 
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FIGURE  27 
STTE  C  BROWN  356 
100%  COTTON  POPUN  RIPSTOP 
AA  -  STTE  CVS.  AA  -  NATICK 


FIGURE  28 

SITE  C  DARK  GREEN  355 
100%  COTTON  POPUN  RIPSTOP 

_ AA  -  SITE  C  VS.  AA  -  NATICK _ 

LEGEND  FOR  SYMBOLS 
FIGURES  25-27 

FIGURES  25  -  27,  UNEAR  REGRESSION  FIT  AT  95  PERCENT 
CONFIDENCE  LEVEL  COMPARING  AA  SRE  C  VS.  AA  NATICK 
FOR  THREE  SHADES  OF  THE  WOODLAND  CAMOUFLAGE 
PATTERN,  100%  COTTON  POPUN  RIPSTOP 


*  =  BOTH  NATICK  AND  SITE  C  RASS 
q  -  BOTH  NATICK  AND  STTE  C  FAIL 


A  =  NATKX  -  RASS,  SITE  C  -  FAIL 
.  -  NATICK  -  FAIL  SITE  C  -  RASS 


LEGEND  FOR  SYMBOLS 
FIGURES  28-30 

FIGURES  28  -  30,  LINEAR  REGRESSION  FIT  AT  95  PERCENT! 
CONFIDENCE  LEVEL  COMPARING  AA  NATICK  VS.  AA  DPSO 
FOR  THREE  SHADES  OF  THE  WOODLAND  CAMOUFLAGE 
PATTERN,  100%  COTTON  POPLIN  RIPSTOP 


.  =  BOTH  DPSCAND  NATICK  PASS 
n  -  BOTH  DPSCAND  NATICK  FAIL 
A  =  DPSC  -  PASS,  NATICK  -  FAIL 
.  =  DPSC  -  FAIL,  NATICK  -  PASS 


Altrsougn  it  is  e:..pec tec  that  different  instruments  will  produce 
slightly  different  cats,  the  L*.  a*  anc  h*  data  tor  both  standard  ana 
sample  data  tor  each  site  were  analyzed  to  determine  if  a  clear  cause 
for  the  differences  could  be  found.  The  variables  which  could  contribute 
to  these  differences  include  the  instruments  themselves  and  instrumental 
error;  the  number  of  operators  with  various  levels  of  measurement 
experience  conducting  testing:;  different  pieces  of  the  standard  roll 
measured  at  each  site,  and , measurement  procedure.  No  definite  patterns 
aopeared  in  the  analysis  but  it  did  indicate  more  variability  in  the  data 
for  the  three  satellite  sites  than  in  the  data  for  either  DPSC  or  Natick. 
This  would  indicate  that  measurement  procedure  is  the  largest  contributing 
factor  to  the  differences  inAA  values  between  testing  sites. 


CONCLUSIONS  AND  RECOMMENDATIONS 

The  analysis  demonstrates  tnat  the  instruments  performed  well  and  the 
system  works  as  intended.  The  implementation  of  the  objective  method  for 
determining  snabe  accepted! ity  into  the  Army's  quality  assurance  program 
will  benefit  the  government  and  industry  by  reducing  disputed 
acceptabi 1 ity  decisions,  reducing  the  turn-around  time  for  the  evaluation 
and  improving  tne  quality  of  military  end  items.  However,  it  is  important 
to  remember  that  this  method,  or  any  other  objective  method  for 
determining  shade  acceptabi 1 i ty ,  is  limited  by  the  state  of  technology  ana 
tne  accuracy  of  the  human  element  in  the  procedure. 

Future  developments  in  the  optics  and  computer  industries  will  bring 
greater  speed  and  accuracy  to  commercially  available  instrumentation , 
which  is  presently  very  good.  The  human  element  in  the  procedure  remains 
the  important  factor.  Instrumentation  must  be  maintained  conscientiously, 
and  careful  measurement  procedures  are  crucial.  As  Nation:  and  DPSC  work 
to  transition  this  project  from  the  development  to  the  implementation 
stage,  greater  emphasis  will  be  placed  on  training  the  operators  m  proper 
measurement  procedures  to  maintain  the  degree  of  accuracy  that  has  been 
produced  in  the  laboratory,  in  the  industrial  environment. 
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